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Cross Reference to Related Applications 

This application is a continuation-in-part of U.S. Patent Application No. 1 0/063,81 9, 
filed on May 1 5, 2002, pending, which is hereby incorporated by reference in its 
entirety. 

Background of the Invention 

[0001] This invention generally relates to computer aided detection and diagnosis (CAD) 
of an image set. More particularly, this invention relates to a method and system for 
computer aided detection and diagnosis of dual energy ("DE") or multiple energy 
images, as well as of radiographic images, computed tomography images, and 
tomosynthesis images. 

[0002] The classic radiograph or "X-ray" image is obtained by situating the object to be 
imaged between an X-ray emitter and an X-ray detector made of photographic film. 
Emitted X-rays pass through the object to expose the film, and the degree of 
exposure at the various points on the film are largely determined by the density of the 
object along the path of the X-rays. 



It is now common to utilize solid-state digital X-ray detectors (e.g., an array of 
switching elements and photo-sensitive elements such as photodiodes) in place of 
film detectors. The charges generated by the X-rays on the various points of the 
detector are read and processed to generate a digital image of the object in electronic 
form, rather than an analog image on photographic film. Digital imaging is 
advantageous because the image can later be electronically transmitted to other 
locations, subjected to diagnostic algorithms to determine properties of the imaged 




[0003] 
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object, and so on. 

[0004] Dual energy (DE) imaging in digital X-Ray combines information from two 

sequential exposures at different energy levels, one with a high energy spectrum and 
the other with a low energy spectrum. With a digital X-ray detector, these two images 
are acquired sequentially and processed to get two additional images, each 
representative of attenuation of a given tissue type, for example bone and soft tissue 
images. A multiple energy imaging system can be built that can be used to further 
decompose the tissues in an anatomy. A series of images at different energies / kVps 
(Energy 1 , . . . Energy n) can be acquired in a rapid sequence and decomposed into 
different tissue types (Tissue 1 , . . . Tissue n). 

[0005] Computed tomography (CT) systems typically include an x-ray source collimated 
to form a fan beam directed through an object to be imaged and received by an x-ray 
detector array. The x-ray source, the fan beam and detector array are orientated to lie 
within the x-y plane of a Cartesian coordinate system, termed the "imaging plane". 
The x-ray source and detector array may be rotated together on a gantry within the 
imaging plane, around the imaged object, and hence around the z-axis of the 
Cartesian coordinate system. 

[0006] The detector array is comprised of detector elements each of which measures the 
intensity of transmitted radiation along a ray path projected from the x-ray source to 
that particular detector element. At each gantry angle a projection is acquired 
comprised of intensity signals from each of the detector elements. The gantry is then 
rotated to a new gantry angle and the process is repeated to collect a number of 
projections along a number of gantry angles to form a tomographic projection set. 
Each acquired tomographic projection set may be stored in numerical form for later 
computer processing to reconstruct a cross sectional image according to algorithms 
known in the art. The reconstructed image may be displayed on a conventional CRT 
tube, flat-panel thin-film-transistor array, or may be converted to a film record by 
means of a computer-controlled camera. 

[0007] Tne f an beam may be filtered to concentrate the energies of the x-ray radiation 

into high and low energies. Thus, two projection sets may be acquired, one at high x- 
ray energy, and one at low x-ray energy, at each gantry angle. These pairs of 
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projection sets may be taken at each gantry angle, alternating between high and low 
x-ray energy, such that patient movement creates minimal problems. Alternatively, 
each projection set may be acquired in separate cycles of gantry rotation, such that x- 
ray tube voltage and filtering need not be constantly switched back and forth. 

[0008] Diagnosis from radiographic images, computed tomography images, and other 
medical images has traditionally been a visual task. Due to the subjective nature of 
the task, the diagnosis is subject to reader variability. In addition, due to the 
underlying and overlying structures relevant to the pathologies of interest, visual 
assessment can be difficult. Subtle rib fractures, calcifications, and metastatic bone 
lesions (metastases) in the chest can be difficult to detect on a standard chest X-ray. 
As an additional example, only 5-25% of pulmonary nodules are detected today with 
chest radiographs, but 3 5-50% are visible in retrospect. In a CT acquisition, different 
regions of the imaged object can be composed of different tissues of differing 
densities such that the total attenuation (thus CT number and pixel value) are the 
same. These two regions would have identical representation in the image, and thus 
be indistinguishable. Dual energy CT offers the ability to discriminate between the two 
tissue types. Traditionally, this discrimination would still be a visual task. 

Summary of the Invention 

[0009] The above discussed and other drawbacks and deficiencies are overcome or 
alleviated by a method for computer aided processing of dual or multiple energy 
images including employing a data source, the data source including a dual or 
multiple energy image set including a high energy image, a low energy image, a bone 
image, and a soft tissue image, defining a region of interest within an image from the 
dual or multiple energy image set, extracting feature measures from the region of 
interest, and reporting at least one of the feature measures on the region of interest. 

[0010] . r ■ i , ■ r J l 

In another embodiment, a system for computer aided processing of dual energy 

images may include a detector generating a first image representative of photons at a 

first energy level passing through a structure and a second image representative of 

photons at a second energy level passing through the structure, a memory coupled to 

the detector, the memory storing the first image and the second image, a processing 

circuit coupled to the memory, the processing circuit processing a dual energy image 
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set including a first decomposed image, a second decomposed image, a high energy 
image, and a low energy image from the first image and the second image, storing the 
dual energy image set in the memory as a data source, defining a region of interest 
within an image from the dual energy image set, and extracting feature measures 
from the region of interest, and a reporting device coupled to the processing circuit, 
the reporting device reporting at least one of the feature measures. 

[001 1] In another embodiment, a storage medium encoded with a machine readable 

computer program code including instructions for causing a computer to implement a 
method for aiding in processing of dual or multiple energy images, where the method 
includes employing a data source, the data source including a dual or multiple energy 
image set having a first decomposed image, a second decomposed image, a high 
energy image, and a low energy image, defining a region of interest within an image 
from the dual or multiple energy image set, extracting feature measures from the 
region of interest, and employing a feature selection algorithm on the feature 
measures for identifying an optimal set of features. 

[0012] In another embodiment, a method for detecting bone fractures, calcifications or 
metastases includes utilizing a bone image from a dual or multiple energy image set, 
selecting a region of interest within the bone image to search for a calcification, 
fracture, erosion, or metastatic bone lesion, segmenting bone from a background of 
the bone image, and identifying a candidate region within the bone as a candidate for 
a calcification, fracture or metastatic bone lesion. 

[001 3] In another embodiment, a method for detecting lung disease includes utilizing a 
soft-tissue image from a dual or multiple energy image set, selecting a region of 
interest within the soft-tissue image to search for an indication of disease, 
segmenting the region of interest from a background of the soft-tissue image, 
identifying a candidate region within a bone image which correlates to the region of 
interest in the soft-tissue image, extracting features from the candidate region in the 
bone image, and classifying the region of interest in the soft-tissue image as a 
candidate for soft-tissue disease utilizing the features extracted from the bone image. 

[001 4] | n ano ther embodiment, a method for computer aided processing of computed 
tomography images includes acquiring an image set of dual energy computed 
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tomography images, employing a data source, the data source including the image 
set, defining a region of interest within an image from the image set, extracting 
feature measures from the region of interest, and reporting at least one of the feature 
measures on the region of interest. 

[001 5] In another embodiment, a method for computer aided processing of volumetric 

computed tomography images includes acquiring an image set of volumetric 
computed tomography images from projections taken at different angles of a 
structure, employing a data source, the data source including the image set, defining 
a region of interest within an image from the image set, extracting feature measures 
from the region of interest, and reporting at least one of the feature measures on the 
region of interest. 

[0016] In another embodiment, a method for computer aided processing of 

tomosynthesis images includes acquiring an image set of tomosynthesis images, 
employing a data source, the data source including the image set, defining a region of 
interest within an image from the image set, extracting feature measures from the 
region of interest, and reporting at least one of the feature measures on the region of 
interest. 

[0017] The above discussed and other features and advantages of the present invention 
will be appreciated and understood by those skilled in the art from the following 
detailed description and drawings. 

Brief Description of the Drawings 

[001 8] Referring to the exemplary drawings wherein like elements are numbered alike in 

the several FIGS.: 

[001 9] FIG. 1 is a block diagram of an exemplary X-ray imaging system; 

[0020] FIG. 2 is a high-level flowchart of an exemplary image acquisition and processing 

process; 

[0021] FIG. 3 is a flowchart of exemplary image acquisition processing; 

[0022] FIG. 4 is a flowchart of exemplary image pre-processing; 
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[0023] FIG. 5 is a flowchart of exemplary image post-processing; 

[0024] FIG. 6 is a flowchart of a computer aided process of detection and diagnosis of 

dual energy images; 

[0025] FIG. 7 is a flowchart of another computer aided process of detection and diagnosis 
of dual energy images; 

[0026] FIG. 8 is flowchart of an exemplary feature selection algorithm for use in the 
computer aided process of FIGS. 6 and 7; 

[0027] FIG. 9 is a flowchart of an exemplary classification algorithm for use in the 
computer aided process of FIGS. 6 and 7; 

[0028] FIG. 1 0 is a flowchart of a computer aided process of detecting calcifications, 
fractures, erosions, and metastases in a bone image; 

[0029] FIG. 1 1 is a flowchart of a computer aided algorithm for use in the process of FIG. 
10; 

[0030] FIG. 1 2 is a flowchart of a computer aided process of detection and diagnosis of 
multiple energy images; 

[003 1 ] FIG. 1 3 is a signal flow diagram of a system capable of performing pre- 
reconstruction analysis; 

[0032] FIG. 1 4 is a signal flow diagram of a system capable of performing post- 
reconstruction analysis; 

[0033] FIG. 1 5 is a flowchart of a computer aided process of detection and diagnosis of 
dual energy CT images; 

[0034] FIG. 1 6 is a flowchart of a computer aided process of detection and diagnosis of 
volume CT images; 

[003 5] FIG. 1 7 is a flowchart of a computer aided process of detection and diagnosis of 
dual energy volume CT images; 

[0036] , J . _ 

FIG. 1 8 is a flowchart of a computer aided process of detection and diagnosis ot 
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tomosynthesis images; and, 

[0037] FIG. 1 9 is a flowchart of a computer aided process of detection and diagnosis of 
dual energy tomosynthesis images. 

Detailed Description 

[0038] FIG. 1 illustrates an exemplary X-ray imaging system 1 00. The imaging system 

100 includes an X-ray source 102 and a collimator 104, which subject structure under 
examination 1 06 to X-ray photons. As examples, the X-ray source 1 02 may be an X- 
ray tube, and the structure under examination 1 06 may be a human patient, test 
phantom or other inanimate object under test. The X-ray source 102 is able to 
generate photons at a first energy level and at least a second energy level different 
than the first energy level. Multiple, more than two, energy levels are also within the 
scope of this method and system. 

[0039] X ray jmaging system i 00 also includes an image sensor 1 08 coupled to a 

processing circuit 1 1 0. The processing circuit 1 1 0 (e.g., a microcontroller, 
microprocessor, custom ASIC, or the like) is coupled to a memory 1 1 2 and a display 
1 1 4. The display 1 1 4 may include a display device, such as a touch screen monitor 
with a touch-screen interface. As is known in the art, the system 1 00 may include a 
computer or computer-like object which contains the display 1 1 4. The computer or 
computer-like object may include a hard disk, or other fixed, high density media 
dives, connected using an appropriate device bus, such as a SCSI bus, an Enhanced 
IDE bus, a PCI bus, etc., a floppy drive, a tape or CD ROM drive with tape or CD media, 
or other removable media devices, such as magneto-optical media, etc., and a mother 
board. The motherboard includes, for example, a processor, a RAM, and a ROM, I/O 
ports which are used to couple to the image sensor 1 08, and optional specialized 
hardware for performing specialized hardware/ software functions, such as sound 
processing, image processing, signal processing, neural network processing, etc., a 
microphone, and a speaker or speakers. Associated with the computer or computer- 
like object may be a keyboard for data entry, a pointing device such as a mouse, and a 
mouse pad or digitizing pad. Stored on any one of the above-described storage media 
(computer readable media), the system and method include programming for 
controlling both the hardware of the computer and for enabling the computer to 
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interact with a human user. Such programming may include, but is not limited to, 
software for implementation of device drivers, operating systems, and user 
applications. Such computer readable media further includes programming or 
software instructions to direct the general purpose computer to performance in 
accordance with the system and method. The memory 1 12 (e.g., including one or 
more of a hard disk, floppy disk, CDROM, EPROM, and the like) stores a high energy 
level image 1 1 6 (e.g., an image read out from the image sensor 1 08 after 1 1 0-1 40 
kVp 5 mAs exposure) and a low energy level image 1 1 8 (e.g., an image read out after 
70 kVp 2 5 mAs exposure). Processing circuit 1 10 provides an image 120 for display 
on device 1 1 4. As described in further detail herein, the image 1 20 may be 
representative of different structures (e.g., soft-tissue, bone). The image sensor 108 
may be a flat panel solid state image sensor, for example, although conventional film 
images stored in digital form in the memory 1 1 2 may also be processed as disclosed 
below as well. 

[0040] Operation of the system of FIG. 1 will now be described with reference to FIGS. 2- 
6. FIG. 2 depicts a high-level flowchart of exemplary processing performed by the 
system of FIG. 1 . The process begins at step 1 0 with image acquisition. An exemplary 
image acquisition routine is shown in FIG. 3. As shown in FIG. 3, the image acquisition 
routine includes a technique optimization step 1 1 that includes processing such as 
automatic selection of acquisition parameters such as kVp (High and Low), mAs, 
additional filtration (for example, copper or aluminum), timing, etc. The acquisition 
parameters can be based on variables provided by the user (such as patient size) or 
obtained automatically by the system (such as variables determined by a low-dose 
"pre-shot"). Selection of the acquisition parameters may address problems such as 
residual structures, lung/heart motion, decomposition artifacts and contrast. 

[0041] Once the acquisition parameters are defined, cardiac gating is utilized at step 12. 
Cardiac gating is a technique that triggers the acquisition of images by detector 1 08 
at a specific point in the cardiac cycle. This reduces heart-motion artifacts in views 
that include the heart, as well as artifacts indirectly related to heart motion such as 
lung motion. Cardiac gating addresses lung/heart motion artifacts due to heart/aortic 
pulsatile motion. 
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[0042] The acquisition of two successive x-ray images at high kVp and low kVp, with a 
minimum time in between, is depicted as steps 13 and 14, respectively. The filtration 
of collimator 1 04 may be changed in between acquisitions to allow for greater 
separation in x-ray energies. Detector corrections may be applied to both the high 
energy image and low energy image at steps 1 5 and 16, respectively. Such detector 
corrections are known in systems employing flat panel detectors and include 
techniques such as bad pixel/line correction, gain map correction, etc., as well as 
corrections specific to dual energy imaging such as laggy pixel corrections. 

[0043] Referring to FIG. 2, once the acquisition step 1 0 is completed, flow proceeds to 
step 20 where the acquired images are pre-processed. FIG. 4 is flowchart of an 
exemplary pre-processing routine. The pre-processing includes a scatter correction 
step 22 which may be implemented in software and/or hardware. The scatter 
correction routine may be applied to each image individually or utilize common 
information from both the high kVp and the low kVp images to reduce scatter. 
Existing scatter correction techniques may be used such as hardware solutions 
including specialized anti-scatter grids, and or software solutions using convolution- 
based or deconvolution-based methods. Additionally, software techniques can utilize 
information from one image to tune parameters for the other image. Scatter 
correction addresses decomposition artifacts due to x-ray scatter. 

[0044] Once scatter correction is performed, noise reduction is performed at step 24 
where one or more existing noise reduction algorithms are applied to the high kVp 
and the low kVp images, either individually or simultaneously. The noise correction 
addresses increased noise that may result from the DE decomposition. At step 26, 
registration is performed to reduce motion artifacts by correcting for motion and 
aligning anatomies between the high kVp and the low kVp images. The registration 
algorithms may be known rigid-body or warping registration routines applied to the 
high kVp and the low kVp images. Alternatively, the techniques may be iterative and 
make use of the additional information in decomposed soft-tissue and bone images 
developed at step 30. The registration processing addresses residual structures in the 
soft-tissue image and/or the bone image and lung/heart motion artifacts. 

[0045] 

Referring to FIG? 2, once the pre-processing step 20 is completed, flow proceeds 
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to step 30 where the acquired images are decomposed to generate a raw soft-tissue 
image and a raw bone image. A standard image (also referred to as a standard 
posterior-anterior (PA) image) is also defined based on the high kVp image. The 
decomposition may be performed using known DE radiography techniques. Such 
techniques may include log-subtraction or basis material decomposition to create raw 
soft-tissue and raw bone images from the high-energy and low-energy acquisitions. 
Information from the raw soft-tissue image and raw bone image may be used in the 
registration/motion correction step 26. For example, edge information and/or artifact 
location information can be derived from the decomposed images for use in the 
registration/motion correction. 

[0046] Referring to FIG. 2, once the decomposition step 30 is completed, flow proceeds 
to step 40 where the acquired images are post-processed. FIG. 5 is a flowchart of an 
exemplary post-processing routine. As shown in FIG. 5, the raw soft-tissue image 41 
and the raw bone image 42 are subjected to similar processing. Contrast matching 43 
is performed match contrast of structures in raw soft-tissue image 41 and the raw 
bone image 42 to the corresponding structures in a standard image. For example, 
contrast of soft-tissue structures in raw soft-tissue image 41 (e.g., chest image) is 
matched to the contrast in the standard PA image. The contrast matching is 
performed to facilitate interpretation of the x-ray images. 

[0047] At 44, one or more noise reduction algorithms may be applied to the soft-tissue 
image 41 and the bone image 42. Existing noise reduction algorithms may be used. 
The noise reduction addresses noise due to DE decomposition. At 45, presentation 
image processing may be performed to the soft-tissue image 41 and the bone image 
42. The presentation processing includes processes such as edge enhancement, 
display window level and window width adjustments for optimal display. The result of 
the post-processing 40 is depicted as processed soft-tissue image 46 and processed 
bone image 47. 

[0048] Referring to FIG. 2, once the post-processing step 40 is completed, flow proceeds 
to step 50 where the acquired images are processed for display. 

[0049] Computer-aided algorithms have the potential of improving accuracy and 

reproducibility of disease detection when used in conjunction with visual assessment 
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by radiologists. Computer-aided algorithms can be used for detection (presence or 
absence) or diagnosis (normal or abnormal). The detection or diagnosis is performed 
based upon knowledge acquired by training on a representative sample database. The 
sample data in the database and the features of the data that the algorithms are 
trained are two important aspects of the training process that affect the performance 
of CAD algorithms. The accuracy of the CAD algorithms improves with improvements 
on the information it is trained on. With conventional radiographs, overlying and 
underlying structures confound the relevant information making diagnosis or 
detection difficult even for computerized algorithms. The method and system 
described herein addresses this problem by using dual energy images, in particular, in 
conjunction with conventional radiographic images for CAD. In particular, this method 
combines information from four images to aid computerized detection algorithms. 

[0050] As shown in FIG. 6 the dual energy CAD system 200 has several parts including a 
data source 21 0, a region of interest 220, optimal feature selection 230, and 
classification 240, training 250, and display of results 260. 

[0051] , t s hould be noted here that dual energy CAD 200 may be performed once by 

incorporating features from all images 21 5 or may be performed in parallel. As shown 
in FIG. 7, the parallel operation for a dual energy CAD 201 would involve performing 
CAD operations, as described in FIG. 6, individually on each image 216, 217, 218, 219 
and combining the results of all CAD operations in a synthesis/classification stage 
214. That is, the ROI selection 220 can be performed on each image 216, 217, 218, 
and 21 9 to provide a low energy image ROI 221 , a high energy image ROI 222, a soft 
tissue image ROI 223, and a bone image ROI 224. Likewise, the optimal feature 
extraction stage 230 can be performed on each image ROI 221 , 222, 223, and 224 to 
result in low energy image features 23 1 , high energy image features 232, soft tissue 
image features 233, and bone image features 234. At the synthesis / classification 
stage 241 , the results of all of the CAD operations can be combined. Thus, FIGS. 6 and 
7 show two different methods of performing dual energy CAD, however other 
methods are also within the scope of this invention such as the ROI selection stage 
220 performing in parallel as shown in FIG. 7, but the feature extraction stage 230 
performing on a combined ROI such as shown in FIG. 6. In addition, CAD operations to 
detect multiple diseases, fractures, or any other medical condition can be performed 
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in series or parallel. 

[0052] Referring now to either FIGS. 6 or 7, for the data source 210, data may be 
obtained from a combination of one or more sources. Image acquisition system 
information 212 such as kVp (peak kilovoltage, which determines the maximum 
energy of the X-rays produced, wherein the amount of radiation produced increases 
as the square of the kilovoltage), mA (the X-ray tube current is measured in 
milliamperes, where 1 mA = 0.001 A), dose (measured in Roentgen as a unit of 
radiation exposure, rad as a unit of absorbed dose, and rem as a unit of absorbed 
dose equivalent), SID (Source to Image Distance), etc., may contribute to the data 
source 210. Patient demographics/symptoms/history 214 such as smoking history, 
sex age, and clinical symptoms may also be a source for data 210. Dual energy image 
sets 2 1 5 (high energy image 2 1 6, low energy image 2 1 7, bone image 2 1 8, soft tissue 
image 21 9, or alternatively stated, first and second decomposed images in lieu of 
bone image 21 8 and soft tissue image 219, where first and second decomposed 
images may include any material images including, but not limited to, soft tissue and 
bone images) are an additional source of data for the data source 210. 

[0053] On the image-based data 21 5, a region of interest 220 can be defined from which 
to calculate features. The region of interest 220 can be defined several ways. For 
example, the entire image 215 could be used as the region of interest 220. 
Alternatively, a part of the image, such as a candidate nodule region in the apical lung 
field could be selected as the region of interest 220. The segmentation of the region 
of interest 220 can be performed either manually or automatically. The manual 
segmentation may involve displaying the image and a user delineating the area using, 
for example, a mouse. An automated segmentation algorithm can use prior 
knowledge such as the shape and size to automatically delineate the area of interest 
220. A semi-automated method which is the combination of the above two methods 
may also be used. 

[0054] 

The feature selection algorithm 230 is then employed to sort through the 
candidate features and select only the useful ones and remove those that provide no 
information or redundant information. With reference to FIG. 8, the feature extraction 
process, or optimal feature extraction 230, involves performing computations on the 
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data sources 210. For example, on the image-based data 215, the region of interest 
statistics such as shape, size, density, curvature can be computed. On acquisition- 
based 212 and patient-based 214 data, the data 212, 214 themselves may serve as 
the features. As further shown in FIG. 8, the multiple feature measures 270 from the 
high energy image, low energy image, soft image, and bone images or a combination 
of those images are extracted, for example measured features such as shape, size, 
texture, intensity, gradient, edge strength, location, proximity, histogram, symmetry, 
eccentricity, orientation, boundaries, moments, fractals, entropy, etc., patient history 
such as age, gender, smoking history, and acquisition data such as kVp and dose. The 
term "feature measures" thus refers to features which are computed, features which 
are measured, and features which just exist. A large number of feature measures are 
included, however the method ensures that only the features which provide relevant 
information are maintained. Step 272 within the feature selection algorithm 230 refers 
to feature evaluation 272 in terms of its ability to separate the different classification 
groups using, for example, distance criteria. Distance criteria will evaluate how well, 
using a particular feature, the method can separate the different classes that are used. 
Several different distance criteria can be used such as divergence, Bhattacharya 
distance, Mahalanobis distance. These techniques are described in "Introduction to 

Statistical Pattern Recognition", K. Fukanaga, Academic Press, 2 nd ed., 1990, which is 
herein incorporated by reference. Step 274 ranks all the features based on the 

distance criteria. That is, the features are ranked based on their ability to differentiate 

between different classes, their discrimination capability. The feature selection 

algorithm 230 is also used to reduce the dimensionality from a practical standpoint, 

where the computation time might be too long if the number of features to compute 

is large. The dimensionality reduction step 276 refers to how the number of features 

are reduced by eliminating correlated features. Extra features which are merely 

providing the same information as other features are eliminated. This provides a 

reduced set of features which are used by the forward selection step 278 which 

selects the highest ranked features and then adding additional features, based on a 

descending ranking, until the performance no longer improves. That is, no more 

features are added when the point is reached where adding additional features no 

longer provides any useful information. At this point, the output 2 80 provides an 

optimal set of features. 
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[0055] Once the features, such as shape, size, density, gradient, edges, texture, etc., are 
computed as described above in the feature selection algorithm 230 and an optimal 
set of features 280 is produced, a pre-trained classification algorithm 240 can be 
used to classify the regions of interest 220 into benign or malignant nodules, 
calcifications, fractures or metastases, or whatever classifications are employed for 
the particular medical condition involved. With reference to FIG. 9, the set of features 
280 is used as the input to the classification algorithm 240. In step 282, the 
normalization of the feature measures from set 280 is performed with respect to 
feature measures derived from a database of known normal and abnormal cases of 
interest. This is taken from the prior knowledge from training 250. The prior 
knowledge from training may contain, for example, examples of features of confirmed 
malignant nodules and examples of features of confirmed benign nodules. The 
training phase 250 may involve, for example, the computation of several candidate 
features on known samples of benign and malignant nodules. Step 2 84 refers to 
grouping the normalized feature measures. Several different methods can be used 
such as Bayesian classifiers (an algorithm for supervised learning that stores a single 
probabilistic summary for each class and that assumes conditional independence of 
the attributes given the class), neural networks (which works by creating connections 
between processing elements whereby the organization and weights of the 
connections determine the output; neural networks are effective for predicting events 
when the networks have a large database of prior examples to draw on, and are 
therefore useful in image recognition systems and medical imaging), rule-based 
methods (which use conditional statements that tells the system how to react in 
particular situations), fuzzy logic (which recognizes more than simple true and false 
values), clustering techniques, and similarity measure approach. Such techniques are 
described in "Fundamentals of Digital Image Processing" by Anil K.Jain, Prentice Hall 
1988, herein incorporated by reference. Once the normalized feature measures have 
been grouped, then the classification algorithm 240 labels the feature clusters in step 
286 and outputs in step 288 a display of the output. 

[0056] 

Dual-energy techniques enable the acquisition of multiple images for review by 
human or machine observers. CAD techniques could operate on one or all of the 
images 216, 217, 218, and 219, and display the results 260 on each image 216, 217, 
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218, and 219, or synthesize the results for display 260 onto a single image 21 5. This 
would provide the benefit of improving CAD performance by simplifying the 
segmentation process, while not increasing the quantity of images to be reviewed. 
This display of results 260 forms part of the presentation phase 50 shown in FIG. 2. 

[0057] Following identification 230 and classification 240 of a suspicious candidate 
region, its location and characteristics should be displayed to the radiologist or 
reviewer of the image. In non-dual-energy CAD applications this is done through the 
superposition of a marker, for example an arrow or circle, near or around the 
suspicious lesion. Dual-energy CAD affords the ability to display markers for 
computer detected (and possibly diagnosed) nodules on any of the four images (high 
energy image 21 6, low energy image 21 7, bone image 21 8, soft tissue image 219). In 
this way, the reviewer may view only a single image 215 upon which is superimposed 
the results from an array of CAD operations 200. The CAD system 201 synthesizes the 
results in step 241 when the images are processed separately as shown in FIG. 7. Each 
CAD operation (defined by a unique segmentation (ROI) 220, feature extraction 230, 
and classification procedure 240 or 241) may be represented by a unique marker 
style. 

[0058] An exam p|e of such a dual energy CAD display will be described for lung cancer 
chest imaging. Let us assume that a patient has a dual-energy exam (as described 
with reference to FIGS. 1-5) that is then processed with a dual-energy CAD system 
200 or 201 . A CAD operation identifies two suspicious lesions characteristic of 
malignancy on the soft-tissue image 2 1 9. On the bone-image 2 1 8, a CAD operation 
identifies a calcified nodule (indicating a benign process), and a bone lesion. At the 
synthesis stage, which may form part of the classification process when either or both 
of the ROI and feature extraction stages apply to each image, the classification 240 
takes these results and determines that one of the soft-tissue nodules is the same as 
the calcified nodule apparent on the bone-image 218. The reviewer would then be 
presented with the high energy image 216, a first image - taken with a technique to 
mimic what is currently standard practice for single-energy chest radiography. The 
reviewer would also be presented with a second image, the same image as the first 
image but with markers indicating the results of the CAD operations 220, 230, 240 
superimposed on the image data. This second image could be simultaneously 
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displayed on a second hard-or soft-copy image display, or toggled with the other 
images via software on a soft-copy display. Superimposed upon the second image 
may be, for example, circles around the suspicious lung nodule classified as having 
characteristics of malignancy, a square around the calcified lung nodules classified as 
benign, and an arrow pointing to the detected bone lesions. In this manner, the 
reviewer gets the benefit of the information from CAD operations 200 on each image 
presented simultaneously for optimal review. 

[0059] As another example, the methods 200, 201 may be used in mammography. Dual 
energy imaging for mammography has been previously employed, such as described 
in U.S. Pat. No. 6,1 73,034 to Chao. Advantageously, the methods 200, 201 may take 
the results of a dual energy imaging process performed for mammography and 
employ the CAD techniques as described herein. Also, it should be noted that the 
energies employed in mammography may be as low as 20kVp as opposed to the 
energies employed typically in the above-described chest exam which may be in the 
range of 50-170 kVp. Conventional mammographies are typically 24-30kVp, and DE 
mammographies can be 24-30kVp for the low energy image and 50-80 kVp for the 
high energy image, where values are often limited by the x-ray tube/generator. For 
CT mammographies, the energies may be higher, about 80kVp for a conventional 
single energy image. 

[0060] These methods 200, 201 improve the performance of computer-aided detection 
or diagnosis algorithms by providing input data with overlying structures removed. 
Also, since the imaged anatomy is separated based on tissue type (soft tissue or 
bone), this algorithm 200 has the potential of extracting more diagnostic features per 
anatomy than with standard radiography. 

[0061] 

Previous CR (computed radiography) dual-energy images are of rather poor 
quality and noisy compared to the standard radiology image and thus computer-aided 
algorithms have not been previously employed on such images. This system and 
method 200, 201 uses information from high energy image 216, low-energy image 
217, soft-tissue image 219, and bone images 21 8 in addition to acquisition 
parameters 212 and patient information 214. Furthermore, the results can be 
displayed to the reviewer without increasing the number of images over that of 
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conventional CAD techniques. 

[0062] The above-described methods 200, 201 can additionally be utilized for 

identification of calcifications, bone fractures, bone erosions, and metastatic bone 
lesions. By providing a bone image 218 with no over/underlying soft-tissue, DE 
imaging creates an effective opportunity for automatic detection and classification of 
subtle bone fractures, bone erosions, calcifications and metastases that might 
otherwise be missed by the standard image reader. 

[0063] Turning now to FIGS. 1 0 and 1 1 , a diagrammed example of the methods 200, 201 
is shown. The method 301 uses a dual energy computer-aided detection/diagnosis 
(CAD) algorithm 300 for segmenting the bone from the background and 
detecting/identifying candidate bone regions with possible calcifications, fractures or 
metastases. These candidate regions are then classified based on features extracted 
from the corresponding complete image set 21 5 (high-energy 216, low-energy 217, 
bone 218, and soft-tissue 219). The classification stage not only rules out what it 
considers false positives, but can also provide additional information about the 
fracture or lesion (fracture type, lesion size, etc.) The results are then highlighted on 
the images for the reader to assess. 

[0064] As shown in FIG. 1 1 , the first step In a CAD algorithm 300 for detecting 

calcifications, bone fractures, bone erosions, and metastases in DE images 21 5 
requires the selection of the desired area to search, or selection of the region of 
interest (ROI) 3 1 0. In a dual energy chest exam, this would typically include the entire 
image, but may include a smaller region of interest if a specific region were 
suspected. The selection of the region of interest (ROI) 31 0 can be done manually or 
by automated algorithms based on user specifications as described above with 
reference to ROI 220. 

[0065] Nextj segmentation of bone 320 occurs. The purpose of the segmentation 320 is 
to separate the bone from the background (non-bone). One embodiment would be a 
region-growing algorithm. Manual or automated methods can be used for initializing 
region growing. In manual methods, a means is provided for the user to select the 
seed point(s). In automated methods, attributes of the bone such as intensity range, 
gradient range, shape, size etc. can be used for initializing seed points. Another 
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potential segmentation method would involve multi-level intensity thresholding. 

[0066] Then, candidate regions can be identified in step 330. One method for identifying 
candidate regions is based on an edge detection algorithm. To eliminate noise and 
false edges, image processing using morphological erosion could follow. In addition, 
to rule out longer lines that are most likely rib edges, a connectivity algorithm could 
be applied. Therefore, the remaining image consists of only those edges that are 
possible candidates for the calcifications, fractures and metastases. 

[0067] Candidate regions may then be classified in step 340. The classification of the 

remaining candidate regions may comprise a rule-based approach. The rules can be 
different for identification of calcifications, metastases and fractures. There will 
preferably be different rules for the different types of fractures, and different rules for 
the different properties of metastases. For example, for fractures, one might wish to 
separate the edges inside the ribs from the edges outside the ribs, as edges inside the 
ribs are candidates for fractures. Rules could also be based on size measurements of 
the line edges. 

[0068] Remaining candidate regions should then be indicated to the user or reader for 
inspection in a presentation step, or indication of results 350. This could be 
performed by highlighting areas on the original bone image, either with arrows, 
circles, or some other indicator or marker. Additional information such as lesion type 
or size can also be overlaid on the images. 

[0069] Referring again to FIG. 1 0, the indication of results 3 50 may then be read by a 
radiologist or clinician in step 360 and this method 301 can be used to improve the 
detection of calcifications, subtle rib fractures, subtle bone erosions, and metastatic 
bone lesions in chest radiography as exemplified by step 370. The detection of such 
ailments can lead to increased benefit to the patient by early detection, leading to 
improved patient care by the clinician. The ability to provide a bone image without 
over/underlying soft-tissue can also be used to greatly improve detection and 
diagnosis of bone-related pathology. Using the bone image for calcifications, fracture 
and metastases detection is a diagnostic concept for DE imaging which has not 
previously been available. 
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[0070] While specific examples including lung cancer chest imaging and detection of 

calcifications, bone fractures, bone erosions, and metastases have been described, it 
should be understood that the methods and systems described above could be 
employed for detecting and/or diagnosing any medical condition, obstruction, or 
disease involving any part of the body. 

[0071] 

Also, while DE imaging has been specifically addressed, it is further within the 
scope of this invention to employ the above-described methods on multiple energy 
images. For example, a multiple energy imaging system 400 is shown in FIG. 1 2, 
which is similar to the DE imaging systems 200, 201 , and 300 as described above in 
that it includes a data source 410 including image data 41 5, image acquisition data 
412, and patient demographic data 414, defining or selecting a region of interest 420, 
optimal feature extraction 430, synthesis/classification 440, and overlay on image 
display 460. Also as in the previously described DE imaging systems, prior knowledge 
from training 450 is applied to the optimal feature extraction stage 430 and the 
synthesis/classification stage 440. Thus, the only distinction between the method 400 
and the previously described DE methods is the content of the image data 41 5. That 
is, while the DE methods utilize a high energy image, a low energy image, a soft tissue 
image and a bone image, the multiple energy imaging system 400 uses a series of 
images 41 3 taken at different energies/kVps (Energy 1 image, Energy 2 image, ... 
Energy N image). It should be noted that "N" denotes an arbitrary number and may 
change from one imaging process to the next. While these images 41 3 can be 
acquired in a rapid sequence and decomposed into a bone image 41 8 and different 
tissue type images, they may also be decomposed into different material images 
(material 1 image, material 2 image, ... material N image) which may or may not 
include a bone image. Information from one or more of these images can be used to 
detect and diagnose various diseases or medical conditions. As an example, if a 
certain disease needs to be detected, regions of interest can be identified and features 
can be computed on material 2 image and the Energy 1 image. For a different disease 
type, all the images may be used. As in the DE energy imaging systems, region of 
interest selection, optimal feature computation, and classification may be performed 
in series or in parallel on the image data 41 5. For the purposes of this specification, it 
should further be noted that "multiple" energy imaging may encompass dual energy 
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imaging, since two images are multiple images. 

[0072] The CAD system and methods described above may further extend to dual or 
multiple energy computed tomography. Referring to FIGS. 1 3 and 1 4, pre- 
reconstruction analysis and post-reconstruction analysis are prior art techniques 
generally recognized for using dual energy X-ray sources in materials analysis. In pre- 
reconstruction analysis 502, the signal flow is as shown in FIG. 13. The system 1 00 is 
typically similar to the one shown in FIG. 1 and has an X-ray source capable of 
producing a fan beam at two distinct energy levels (i.e., dual energy). The data 
acquisition system 504 gathers signals generated by detector array at discrete angular 
positions of the rotating platform (not shown) and passes the signals to the pre- 
processing element 506. The pre-processing element 506 re-sorts the data it receives 
from the data acquisition system 504 in order to optimize the sequence for the 
subsequent mathematical processing. The pre-processing element 506 also corrects 
the data from the data acquisition system 504 for detector temperature, intensity of 
the primary beam, gain and offset, and other deterministic error factors. Finally, the 
pre-processing element 506 extracts data corresponding to high-energy views and 
routes it to a high energy channel path 508, and routes the data corresponding to 
low-energy views to a low energy path 510. The projection computer 512 receives the 
projection data on the high energy path 508 and the low energy path 510 and 
performs Alvarez/Macovski Algorithm processing to produce a first stream of 
projection data 514 which is dependent on a first parameter of the material being 
scanned and a second stream of projection data 5 1 6 which is dependent on a second 
parameter of the material scanned. The first parameter is often the atomic number 
and the second parameter is often material density, although other parameters may 
be selected. A first reconstruction computer 518 receives the first stream of projection 
data 514 and generates a CT image from the series of projections corresponding to 
the first material parameter. A second reconstruction computer 520 receives the 
second stream of projection data 516 and generates a CT image from the series 
projections corresponding to the second material parameter. 

[0073] | n post-reconstruction analysis 503, the signal flow is as shown in FIG. 14. As is 
described herein for pre-processing analysis 502, a pre-processing element 506 
receives data from a data acquisition system 504, performs several operations upon 
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the data, then routes the data corresponding to high-energy views to a high energy 
path 508 and routes the data corresponding to low-energy views to a low energy path 
510. A first reconstruction computer 51 8 receives the projection data from the high 
energy path 508 and generates a CT image corresponding to the high-energy series 
of projections. A second reconstruction computer 520 receives the projection data 
from the low-energy path 510 and generates a CT image corresponding to the low- 
energy series of projections. A projection computer 512 receives the high energy CT 
data 522 and the low-energy CT data 524 and performs basis material decomposition 
to product CT data 526 which is dependent on a first parameter of the material being 
scanned and a second stream of projection data 528 which is dependent on a second 
parameter of the material scanned. 

[0074] FIG. 1 5 shows the method of computer aided detection and diagnosis 202 revised 
for dual energy CT imaging. The method 202 is similar to the method 200 described 
with respect to FIG. 6, except that multiple CT images 1 a, ... 1 N 530 or 534 and 
multiple CT images 2a, ... 2N 532 or 536, as described above with respect to either 
FIGS. 13 or 14, replace high energy image 216 and low energy image 217 to form 
image set 540. It should be understood that "N" may denote any arbitrary number and 
need not be the same number as the "N" in FIG. 1 2. It should also be understood that 
while soft tissue image 21 9 and bone image 21 8 are shown, the image data 540 could 
instead include first decomposed images and second decomposed images, as 
previously described with respect to FIG. 6. Also, it should be understood that the 
CAD method 201 shown in FIG. 7 could also be revised for dual energy CT. 

[0075] A | so the embodiment shown in FIG. 1 5 could be revised for volume CT where 
images of a structure are collected from multiple angles. Volume CT, or cone-beam 
CT, is a three-dimensional extension of the more familiar two-dimensional fan-beam 
tomography. In fan-beam tomography, a fan collection of X-rays are generated by 
placing a collimator with a long and narrow slot in front of a point X-ray source. A 
cone-beam family of x-rays is made by removing the collimator. This allows the x- 
rays to diverge from the point x-ray source to form a cone-like solid angle. A 
divergent line integral data set results when the x-rays, which penetrate the object, 
are collected by a detector located on the opposite side. Cone-beam tomography 
involves inverting the cone-beam data set to form an estimate of the density of each 
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point inside the object. 

[0076] In current CT scanners, a series of axial images of the object are made and 
stacked on top of each other to form the 3D object. In multi-slice CT, multiple 
detectors are used to collect multiple slices at a given time. On the other hand, in 
cone-beam tomography, the entire data is collected in parallel and then 
reconstructed. Therefore, the cone-beam tomography, in theory, improves both the 
spatial and temporal resolution of the data. FIG. 16 shows a CAD system 600 which 
uses Volume CT images 1 ... N for image data 61 5 such that data source 610 includes 
volume CT images 61 5, image acquisition data 21 2, and patient demographic data 
214. Otherwise, the CAD system is similar to system 200 described with respect to 
FIG. 6. Alternatively, the operations 220, 230, 240 may be performed in parallel on 
each volume CT image as described with respect to FIG. 7. 

[0077] In another embodiment, as shown in FIG. 1 7, a dual energy CAD system 700 uses 
high and low energy Volume CT images la ... IN 71 6 and 2a ... 2N 717, respectively, 
as well as soft tissue images 1 ... N 219 and bone images 1 ... N 21 8 (or alternatively 
first decomposed images and second decomposed images) as image data 71 5, such 
that data source 710 includes image data 71 5, image acquisition data 212, and 
patient demographic data 214. Otherwise, the CAD system 700 is similar to system 
200 described with respect to FIG. 6. Alternatively, the operations 220, 230, 240 may 
be performed in parallel on each Volume CT image and each soft tissue image and 
bone image as described with respect to FIG. 7. 

[0078] While Volume CT CAD 600 and DE Volume CT CAD 700 are described in FIGS. 1 6 
and 1 7, it is further contemplated that multiple energy Volume CT CAD may be 
employed using the methods described with respect to FIG. 12, that is, the method 
shown in FIG. 1 7 may be expanded to incorporate additional energies. 

[0079] As an alternative embodiment, an imaging mode where limited angle x-ray 

tomosynthesis acquisition is performed and reconstructed may be combined with the 
computer aided detection and diagnosis methods described above and as shown in 
FIG. 1 8. Tomosynthesis is performed by acquiring multiple images with a digital 
detector, i.e. series of low dose images used to reconstruct tomography images at any 
level. Tomosynthesis may be performed using many different tube motions including 
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linear, circular, elliptical, hypocycloidal, and others. In tomosynthesis, image 
sequences are acquired, with typical number of images ranging from 5 to 50. Thus, 
the imaging portion of this embodiment may be less expensive, although not 
necessarily preferred, over the CAD CT methods described above. The tomosynthesis 
CAD system 800 shown in FIG. 1 8 is similar to the CT CAD system shown in FIG. 1 6 
except that the image data 81 5 includes tomosynthesis images 1 ... N, such that data 
source 81 0 includes tomosynthesis images 81 5, image acquisition data 212, and 
patient demographic data 214. Other than data source 81 0, the system 800 is similar 
to system 200 described with respect to FIG. 6. Alternatively, the operations 220, 230, 
240 may be performed in parallel on each tomosynthesis image as described with 
respect to FIG. 7. 

[0080] In another embodiment, as shown in FIG. 1 9, a dual energy CAD system 900 uses 
high and low energy tomosynthesis images la ... IN 916 and 2a ... 2N 91 7, 
respectively, as well as soft tissue images 1 ... N 219 and bone images 1 ... N 21 8 (or 
alternatively first decomposed images and second decomposed images) as image data 
91 5, such that data source 91 0 includes image data 91 5, image acquisition data 212, 
and patient demographic data 214. Otherwise, the CAD system 900 is similar to 
system 200 described with respect to FIG. 6. Alternatively, the operations 220, 230, 
240 may be performed in parallel on each tomosynthesis image and each soft tissue 
image and bone image as described with respect to FIG. 7. 

[0081] While tomosynthesis CAD 800 and DE tomosynthesis CAD 900 are described in 
FIGS. 1 8 and 1 9, it is further contemplated that multiple energy tomosynthesis CAD 
may be employed using the methods described with respect to FIG. 1 2, that is, the 
method shown in FIG. 19 may be expanded to incorporate additional energies. 

[0082] 

It should be noted that all of the methods described above may be employed 
within the imaging system 1 00, and in particular, may be stored within memory 1 1 2 
and processed by processing circuit 1 1 0. It is further within the scope of this 
invention that the disclosed methods may be embodied in the form of any computer- 
implemented processes and apparatuses for practicing those processes. The present 
invention can also be embodied in the form of computer program code containing 
instructions embodied in tangible media, such as floppy diskettes, CD-ROMs, hard 
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drives, or any other computer-readable storage medium, wherein, when the computer 
program code is loaded into and executed by a computer, the computer becomes an 
apparatus for practicing the invention. The present invention can also be embodied in 
the form of computer program code, for example, whether stored in a storage 
medium, loaded into and/or executed by a computer, or as data signal transmitted 
whether a modulated carrier wave or not, over some transmission medium, such as 
over electrical wiring or cabling, through fiber optics, or via electromagnetic radiation, 
wherein, when the computer program code is loaded into and executed by a 
computer, the computer becomes an apparatus for practicing the invention. When 
implemented on a general-purpose microprocessor, the computer program code 
segments configure the microprocessor to create specific logic circuits. 

[0083] While the invention has been described with reference to a preferred embodiment, 
it will be understood by those skilled in the art that various changes may be made and 
equivalents may be substituted for elements thereof without departing from the scope 
of the invention. In addition, many modifications may be made to adapt a particular 
situation or material to the teachings of the invention without departing from the 
essential scope thereof. Therefore, it is intended that the invention not be limited to 
the particular embodiment disclosed as the best mode contemplated for carrying out 
this invention, but that the invention will include all embodiments falling within the 
scope of the appended claims. Moreover, the use of the terms first, second, etc. do 
not denote any order or importance, but rather the terms first, second, etc. are used 
to distinguish one element from another. 

[0084] What is claimed is: 
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